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Rear  Admiral  A.  A.  Giordano 
Commander#  Naval  Supply  Systems  Command 

Subject:  The  Aviation  Supply  Office  Continues 

To  Have  Problems  With  the  Accuracy 
of  Its  Requirements  Determinations 
( PLRD-82-26 ) 

Dear  Admiral  Giordano: 


DTJC 

:l  ec  •  e 

WAR  2  9  1982 


We  have  completed  our  review  of  Navy  requirements  determinations 
for  aeronautical  spares  and  repair  parts  at  the  Aviation  Supply 
Office  (ASO)  in  Philadelphia #  Pennsylvania.  This  report  discusses 
ASC's  o'-oblems  in  accurately  determining  carts  requirements. 


We  also  reviewed  the  Navy's  techniques  for  forecasting  lead times 
and  demands .  The  Navy  has  used  some  innovative  techniques  to  iden¬ 
tify  data  trends  and  to  forecast  leadtime  and  demands.  We  believe 
these  techniques  may  be  adaptable  to  other  Department  of  Defense 
requirements  determination  systems.  Our  views,  conclusions,  and 
recommendations  on  this  natter  have  been  presented  in  a  separate 
report  to  the  Secretary  of  Defense  entitled  "The  Services  Should 
I me rove  Their  Processes  For  Determining  Requirements  For  Supplies 
And  Spare  ^arts"  (PLRD-82-12,  Nov.  30/l?8i). 


BACKGROUND 


ASO  provides  logistics  support  for  about  4,430  operating  Navy 
and  Narine  aircraft  valued  at  more  than  $14  billion.  It  ;ses  the 
Navy’s  Uniform  Inventory  Control  Point  computer  program  cc  manage 
about  230,300  items  with  an  inventory  valued  at  $4.5  billion.  ASO 
annually  procures  over  $1  billion  in  spare  parts  and  assemblies  and 
employs  over  2,400  people,  including  about  380  inventory  managers, 
to  carry  out  its  inventory  manaoement  functions. 


w  We  randomly  selected  100  items  from  a  universe  of  2,611 

reparable  and  consumable  items  recommends 3  for  purchase  as  of 
Nay  4,  1980,  and  tested  the  accuracy  of  the  data  elements  used  in 
C  n  determining  these  requirements.  Using  the  results  of  our  review 
of  the  sample  items,  we  developed  projections  at  a  9E -percent 
Li  t  confidence  level. 
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p f  the  100  randomly  selected  items,  we  reviewed  50  with 
supporting  documentation  to  assess  the  validity  and  reasorar  *  eness 
of  tne  requirements  determinations.  Similar  records  were  net 
available  for  the  remaining  50;  therefore,  we  could  not  verify 
these  computations.  We  did,  however,  obtain  comments  from  inven¬ 
tory  managers  and  other  officials  on  changes  made  to  requirements 
computations  and  on  the  disposition  of  recommended  actions  for 
these  items . 

We  also  reviewed  Defense,  Navy,  and  ASO  directives  and  in¬ 
structions  and  studies  made  by  the  Defense  Audit  Service  and  the 
Naval  Audit  Service.  Upon  conclusion  of  the  review,  we  discussed 
the  results  with  ASO  officials  and  incorporated  their  comments  in 
the  report  as  appropriate. 

SUMMARY  OF  RESULTS 

^  ASO  continues  to  have  major  problems  with  the  accuracy  of 
its  requirements  determinations.  Its  automated  requirements 
system  contains  vast  amounts  of  invalid  data,  which  has  caused  re¬ 
quirements  to  be  significantly  overstated.  As  a  result,  extensive 
manual  adjustments  are  needed  before  data  can  be  used  for  deter¬ 
mining  what  items  and  how  many  to  buy.  For  example,  the  automated 
requirements  system  computed  buy  requirements  during  the  May  4, 
1980,  cycle  totaling  $49  5  million.  However,  after  manual  adjust¬ 
ments,  the  inventory  managers  reduced  the  buy  requirements  to  526 
million — a  $469  million  reduction. 

I 

vrhile  we  did  not  find  significant  discrepancies  in  the  adjust¬ 
ments  made  by  inventory  managers,  we  did  identify  the  primary 
reasons  for  the  poor  quality  of  system-generated  data.  Basically, 
the  invalid  system  data  resulted  because 

— available  assets  were  not  reported  to  ASO  in  a 
timely  manner, 

--the  data  base  for  certain  items  was  fragmented, 

“-5CC2SS  to  flies  for  inputting  requirements  fata 
was  not  controlled, 

--inventory  managers'  data  changes  were  not  reviewed# 

--coordination  among  various  ASO  divisions  was  lacking, 

--updating  of  due-in  files  was  not  timely,  and 

--inventory  managers  did  not  review  recommended 
orocurement  actions  in  a  timelv  manner. 


ft  o. 


Additionally,  because  of  the  amount  of  inaccurate  data  in  the 
requirements  system,  we  question  the  validity  of  the  budget ,  which 
is  rased  or.  this  data.  The  above  areas  are  discussed  in  detail 
ir.  the  enclosure  . 

Since  1975,  GAO,  the  Defense  Audit  Service,  and  the  Naval 
Audit  Service  have  reported  similar  types  of  deficiencies  in  the 
Navy's  requirements  system.  Because  the  Navy  has  taken  or  has 
planned  actions  to  correct  some  of  these  deficiencies  and  to 
improve  the  quality  of  its  file  data,  we  are  not  making  recom¬ 
mendations  now.  However,  we  plan  to  monitor  the  Navy's  efforts 
to  improve  the  credibility  of  its  requirements  determination 
system . 

We  appreciate  the  cooperation  shown  to  our  staff  by  ASO 
officials  and  would  like  to  receive  your  comments  on  the  matters 
iscussed  in  this  report.  Copies  of  the  report  are  being  sent  to 
he  Secretary  of  Defense  and  the  Secretary  of  the  Navy. 

Sincerely  yours, 


Henry  VC.  Connor 

Senior  Associate  Director 


Enclosure 


3 


ENCLOSURE 


:losue 


REASONS  EPF  I NVA.L  I  P  5 VET EM 
RE°1"I  EEMENTS  DETERMINATI  ONE  AT  AS I 


AVAILABLE  ASSETS  NOT  REPORTED 
TO  ASO  IN  A  TIMELY  MANNER 


Untimely  reporting  of  assets  by  field  activities  is  a 
significant  factor  in  the  overstatement  of  requirements  and  con¬ 
tinues  to  be  a  supply  discipline  and  accountability  problem  at 
ASO.  3ecause  of  this,  the  item  manager's  visibility  of  system 
assets  is  impaired  and  managers  must  rely  heavily  on  manual  records 
when  determining  requirements  . 

Numerous  reporting  activities  provide  asset  information  to  ASO 
at  different  time  intervals.  For  example,  35  supply  activities 
report  transactions  and  onhand  assets  daily.  However,  about  100 
field  reporting  activities  report  asset  balances  quarterly. 
Therefore,  data  could  be  as  much  as  90  days  old  when  used  in  re¬ 
quirements  computations. 

In  addition,  asset  data  on  items  in  the  Closed  Loop  Aero¬ 
nautical  Management  Program  (CLAMP),  a  separately  managed  program 
for  about  13,500  expensive  and  high  volume,  mission-crit ical 
reparable  items,  is  reported  to  ASO  at  varying  rimes — ranging  from 
weekly  to  monthly.  ASO  updates  its  master  data  files  with  this 
data,  and,  in  turn,  uses  it  to  determine  requirements. 

Inventory  managers  frequently  made  changes  to  the  requirements 
computations  because  the  reported  data  was  outdated  or  inaccurate, 
^he  managers  made  the  most  changes  to  CLAMP  items  in  order  to 
compensate  for  the  outdated  or  inaccurate  data. 

The  managers  are  required  to  recompute  all  CLAMP  requirements 
using  the  “total  approach  method."  Under  this  method,  inventory 
managers  manually  develop  a  history  and  r econci 1 iat ion  on  each 
item,  considering  such  factors  as  how*  many  items  were  initially 
issued,  how  many  were  subsequently  bought,  and  how  many  have  left 
the  system  (losses,  disposals,  etc.).  We  found  that  inventory 
a  cars  redacted  21  of  the  22  recommended  buvs  for  CLAMP  items 
because  of  errors  in  asset  data.  When  projected  to  the  universe 
of  sample  items,  we  estimated  that  deleted  CLAMP  buys  amounted  to 
S124  million. 

ASO  stock  control  officials  acknowledged  that  the  untimely 
reporting  of  available  assets  seriously  affected  the  accuracy  of 
the  data  files.  They  said  many  of  the  assets  errors  w^re  caused 
by  the  multiple  CLAMP  reporting  systems. 


ENCLOSURE 


Until  recently,  CLAMP  items  were  managed  outside  of  the 
no real  Uniform  Inventory  Control  Point  (U1C?)  system.  Basically, 
the  CLAMP  system  was  an  off-line  system  and  used  a  mix  of  manual 
and  automated  techniques  for  processing  requisitions  and  for  re¬ 
porting  essential  data  from  field  activities  to  ASO.  No  central 
data  base  was  established  for  CLAMP  and  various  segments  of  the 
data  base  were  maintained  by  a  contractor,  Navy  wholesale  storage 
sites,  and  ASO.  To  update  its  master  data  files,  ASO  mechanically 
created  asset  and  demand  transactions  and  backorders  with  the 
information  it  received.  CLAMP ' s  fragmented  data  base  and  cumber¬ 
some  and  untimely  update  methods  resulted  in  data  omissions  and 
dupl ica tions .  Furthermore,  these  data  errors  profoundly  affected 
the  budgeting  for  and  procurement  of  materials. 

ASO  recognized  that  the  reporting  systems  were  causing  gross 
inaccuracies  in  its  financial,  stratification,  and  budget  data  sub 
missions.  Additionally,  ASO  was  concerned  with  its  inability  to 
reconcile  backorders  for  CLAMP  items,  which  it  believed  resulted 
in  understated  budgets  . 

In  April  1930,  ASO  implemented  the  Uniform  CLAMP  ( C -CLAMP ) 
system  which  wyas  designed  to  overcome  the  shorzeemi ng s  of  CLAMP 
and  to  provide  a  single  point  of  entry  for  transactions.  This 
system  allowed  ASO  to  update  its  files  on  a  transact ion-by- 
trar.sa  rt  ion  basis.  However,  1  year  after  imp  1  ement  at  ion  of 
C -CLAMP ,  ASO  continued  to  have  significant  problems  with  the 
reliability  of  its  data.  Inventory  managers  distrusted  the  data 
received  from  the  U- CLAMP  system  and  relied  heavily  on  manual 
records  and  other  external  data  sources. 

At  the  time  of  our  review ,  ASO  officials  believed  that  the 
asset  data  was  not  fully  reliable  but  that  its  accuracy  had  im¬ 
proved  somewhat.  Officials  attributed  many  of  the  data  problems 
to  the  TJ- CLAMP  transaction  reporting  system.  To  rectify  the 
problem,  the  Navy’s  Fleet  Materiel  Support  Office  is  making 
certain  program  changes  to  the  L- CLAMP  system.  In  addition,  ASO 
has  scheduled  complete  inventories  at  its  field  reporting 
activities . 

Because  of  these  ongoing  changes,  we  did  not  evaluate  the 
effectiveness  of  the  U-CLAM?  system.  In  our  opinion,  however, 
these  changes  should  help  alleviate  many  of  the  problems  currently 
ha  inn  experienced. 
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RECESS  TD  FILE?  PEP  INPUTTING 
R^5TrI~FLM E^TS  DATA  ~1 5  NOT  CTNTROLLET 

A  SC  does  not-  suf  f  icient  iy  control  oata  input,  to  its  files. 

File  changes  may  be  made  at  any  time  to  program  data,  onhand  and 
d  u  e  -  i  n  assets,  demand  data,  planned  allowances,  etc.  Inventory, 
budget,  procurement,  retail  operations,  system  development,  and 
other  ASO  personnel  have  uncontrolled  access  to  the  data  files  and 
make  numerous  data  changes  that  are  neither  centrally  processed 
nor  centrally  validated.  Statistics  developed  by  the  quality 
assurance  section  and  the  internal  review  branch  for  a  recent  4- 
to  6-week  period  showed  that  about  5,000  direct  terminal  inputs 
and  about  13,000  file  changes  were  made  through  input  documents. 

Our  review  showed  that  invalid  changes  have  resulted  in 
inaccurate  requirements  and  overstated  procurements.  The  recom¬ 
mended  buys  for  six  items,  l'  initially  in  our  selected  sample, 
rota 1 ed  $130  million,  but  the  item  manager  deleted  the  recommenced 
buys  because  of  obvious  invalid  file  changes.  To  illustrate,  one 
item  had  a  recommended  procurement  of  3,613  units  with  a  S21 
million  value.  The  inventory  manager  deleted  the  recommended  buy 
for  the  item  because  its  program  relationship  code  was  invalid. 

-.ST  could  not  determine  who  was  responsible  for  miscoding  the  it 
This  same  item  had  been  reviewed  in  detail  6  weeks  previously  an 
found  to  be  accurately  recorded  with  no  procurement  necessary. 

ASO  officials  noted  that  uncontrolled  access  to  the  files 
significantly  affected  file  data  quality  and  agreed  that  effective 
controls  were  needed.  They  stated  that  the  Fleet  Materiel  Support 
Office  has  been  requested  to  make  changes  to  the  UICP  system  to 
restrict  access  to  data  files. 

INVENTORY  MANAGER 
CHANGES  NOT  REVIEWED 

All  data  changes  made  by  inventory  managers  on  recommended 
buys  were  supposed  to  be  recorded  on  control  documents  and  sent 
to  a  control  group  in  the  supply  control  division.  However,  before 
Eecem'r e r  1930  the  control  group  did  not  review  the  documents. 
Furthermore ,  computer  listings  of  all  data  changes  entered  into 
the  file  were  not  analysed  to  monitor  the  change  actions  and  to 
identify  the  sources  of  invalid  data.  ASO  officials  told  us  that 
as  of  December  1980,  the  control  group  was  to  review  inventory 
managers 1  changes  to  recommended  buys  and  enter  them  into  the  data 
files. 


universe  because 
distort  any  pro- 


1/These  six  items  were  deleted  from  the  sample 
the  recommended  buys  were  atypical  and  would 
-•actions  which  included  these  items . 
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9'  -TIN ATI ON  AVDNG  VARIDUf 
'  DIVISIONS  IS  LACKIN'! 

A  planned  program  r^quirenent  is  a  known  or  anticipated 
requirement  that  cannot  be  exactly  predicted  by  the  'J ICP  forecastin 
technique.  As  of  January  1981,  ASO’s  master  data  file  contained 
over  300,000  planned  program  requirements  valued  at  $4.2  billion, 
of  which  SI. 2  billion  were  funded. 


Inventory  managers  rejected  planned  program  requirements  on 
several  of  our  sample  items  because  the  requirements  duplicated 
previously  negotiated  allowances  established  for  initial  outfitting 
at  operating  sites.  On  the  basis  of  our  analysis,  we  estimated 
that  ASO’s  master  data  file  contained  SI. 7  million  of  invalid 
planned  proaram  requirements. 


The  duplicate  planned  program  requirements  resulted  primarily 
because  of  the  lack  of  coordination  among  the  divisions  involved 
in  making  changes  to  the  flying  hour  program.  Flying  hour  data 
received  from  the  Chief  of  Naval  Operations  were  input  into  the 
requirements  systems  and  new  requirements  were  automatically  com- 
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Another  planned  program  requirement  problem  involves  the 
processing  of  incremental  increases  in  programed  flying  hours.  Th 
UICP  system  considered  the  flying  hour  increases  as  new  require¬ 
ments  for  the  operating  «*ites  instead  of  as  adjustments  to  current 
requirements ,  and  as  a  result,  planned  program  requirements  were 
overstated.  ASO  officials  recognized  this  problem  as  early  as 
April  1977  and  requested  its  system  development  division  to  make 
a  program  adjustment  to  correct  the  problem.  However,  as  of  June 
1981  the  system  development  division  had  not  taken  action  to 
correct  this  deficiency.  A  division  official  told  us  he  would 
discuss  the  matter  with  material  budget  division  personnel  and 
follow  th r ouch  on  the  requested  or our am  chance. 


b? DATING  OF  PUD- IN  FILES 
fs  _N  Of  J?  I  ME' LV 

The  asset  due-in  file  contains  inaccurate  data  because  a 
backlog  exists  cor  posting  updated  information.  Pe cause  of  the 
timelag  in  updating  files,  due-in  ass-ts  are  understated  and  re¬ 
quirements  are  overstated  by  a  cor  r  us  p  -»n  d  i  ng  a  noun  t.  For  example, 
inventory  managers  found  that  due-in  a? sets  for  seven  items  in  our 
samole  were  understated  bv  over  $779,900.  Vfher.  rroaected  to  the 
universe  of  i  hns  in  the  “ay  4,  1^39,  buy  cvc?e,  we  estimate  that 
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ASO  officials  told  us  that  postings  to  the  due-m  file  for 
new  contract  quantities  generally  occur  10  to  14  days  after  the 
procurement  is  authorized,  and  that  postings  for  increased  con¬ 
tract  quantities  can  require  even  more  tine  because  of  delays  in 
processing  contract  amendments  and  certifying  the  availability  of 
funds.  Because  due-in  quantities  are  not  considered  in  the  auto¬ 
mated  system  until  posted,  inventory  managers  record  these  actions 
on  their  manually  maintained  procurement  history  cards  and  use 
this  data  when  reviewing  recommended  procurements.  Consequently, 
manual  records  are  current,  but  the  automated  records  are  not. 

For  example,  a  recommended  buy  of  139  coupling  assemblies  for 
$26,946  was  deleted  primarily  because  the  inventory  managers' 
record  showed  119  units  due-in  which  had  not  been  posted  to  the 
automated  file. 

ASO  officials  said  that  the  accuracy  of  the  due-in  file  has 
been  a  longstanding  problem.  They  told  us  that  ASO  recently  (1) 
acquired  new  data  entry  equipment  which  allows  direct  entry  onto 
tape  from  source  documents  and  (2)  established  a  central  entry 
control  unit  to  make  all  changes  to  the  due-in  file.  The  offi¬ 
cials  believe  that  these  actions  will  improve  the  timeliness  and 
accuracy  of  changes  to  the  due-in  file. 

INVENTORY  MANAGERS  DO  NOT 
REVIEW  RECOMMENDED  PROCUREMENT 
ACTIONS  IN  A  TIMELY  MANNER 


Many  computer-recommended  procurements  are  automatically 
canceled  because  inventory  managers  do  not  review  these  actions 
within  the  35-dav  period  required  by  the  UICP  system.  For  example, 
2"  of  our  100  sample  recommended  buys  were  canceled  for  this  reason 
and  we  estimate  that  $153  million  of  the  May  4,  19S0,  recommended 
buys  were  automatically  canceled  without  review. 

Inventory  managers  said  that  they  were  unable  to  review  all 
recommended  buys  because  of  their  heavy  workload  and  because  of 
delays  in  obtaining  validating  information  from  other  ASO 
divisions  .  According  to  the  r.anacsrs ,  thev  screen  the  recommended 
buys  and  concentrate  on  those  items  that  have  the  greatest  pre- 
cur-r  oent  potential  and  for  which  sufficient  funding  is  available. 

Items  not  reviewed  by  the  inventory  managers  are  logged  in 
by  a  control  group  in  the  stock  control  division,  but  the  inventory 
managers  are  not  required  to  justify  reasons  for  not  reviewing 
them.  ASO  stock  control  officials  said  that  procedures  would  he 
established  whereby  the  division's  control  group  would  monitor 
overdue  actions  and  obtain  jus t i f ica t ion  for  delays  in  reviewing 
system  buy  recommendat ions . 
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Tne  vast  amount  of  inaccurate  data  ir.  the  requirements  system 
raises  serious  questions  about  the  accuracy  and  validity  of  the 
repair  parts  budget  submission  which  is  based  on  this  data. 

Budget  submissions  are  based  on  semi-annual  stratifications 
of  projected  requirements  for  material  needed  18  months  in  the 
future.  For  example,  the  fiscal  year  1982  budget  submission  was 
based  on  the  March  1980  asset  st rat i f ica t i on .  ASO's  stratifica¬ 
tion  program  manipulates  file  data  and  computes  requirements 
levels  and  arranges  them  in  a  priority  sequence.  The  stratifica¬ 
tion  program  applies  assets  to  these  requirements  levels.  If  the 
assets  are  not  sufficient  to  meet  the  requirements ,  the  program 
identifies  the  needed  items  to  meet  the  requirements  level.  The 
total  dollar  value  of  the  stock  deficits  then  becomes  the  basis 
for  the  initial  budget  preparation. 

Much  of  the  data  generated  by  the  strat i f icat ion  program  goes 
through  a  validation  or  scrubbing  process.  Selected  items  account¬ 
ing  for  most  of  the  total  dollar  value  of  projected  procurements 
are  reviewed  by  inventory  managers  for  accuracy  of  the  requirements 
computations.  Necessary  adjustments  are  then  made  to  the  strati¬ 
fication  figures  and  data  corrections  are  made  through  a  central 
entry  point.  A  Navy  Headquarters'  team  reviews  the  stratification 
data  before  submitting  it  to  AST's  budget  division,  which  may  make 
additional  adjustments  before  sending  the  budget  submission  to  Navy 
Headquarters . 

ASO  found  numerous  data  errors  and  made  huge  dollar  reductions 
to  the  stratification  data.  For  example ,  the  March  19ST  initial 
stratification  showed  a  budget  requirement  of  SIS .3  billion.  How¬ 
ever,  the  inventory  managers'  review  identified  11,000  errors  and 
reduced  the  requirement  by  $10.3  billion.  The  budget  division  also 
made  an  additional  $58.5  million  adjustment  for  unfunded/unauthor- 
i red  data  not  purged  from  the  March  1980  stratification  total.  The 
gross  inaccuracies  were  primarily  in  the  CLAM?  report inc  system. 

Our  review  of  the  March  1930  budget  data  was  thwarted  because 
ASO  lacked  supporting  records.  We  attempted  to  determine  whether 
the  fata  changes  made  by  the  inventory  managers  to  the  recommended 
buys  in  our  sample  were  also  made  to  the  final  March  stratification 
before  submission  to  the  budget  division.  ASO  officials  said  that 
the  st ra t i f icat ion  data  tape,  which  supports  the  fiscal  year  lnS2 
budget,  was  erased  before  our  review.  Consequently,  we  oouM  not 
validate  these  changes. 
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